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FOREWORD 


Part  of  the  on-going  research  program  on  leadership  in  the  Army 
Research  Institute  for  the  Behavioral  and  Social  Sciences  (ARI)  is  con¬ 
cerned  with  delineating  and  then  measuring  the  major  factors  that  col¬ 
lectively  comprise  leader  behavior.  ARI  Research  Reports  1172  and  1182 
describe  the  development  of  eight  broad  dimensions  of  leadership  per¬ 
formance,  based  on  analyzing  actual  behavior  in  a  simulated  combat  situ¬ 
ation.  These  dimensions  were  used  to  construct  the  Performance  Evalua¬ 
tion  Form,  which  is  designed  to  measure  overall  officer  duty  performance 
and  evaluate  potential  performance.  Technical  Paper  344  reported  the 
use  of  the  Performance  Evaluation  Form  as  a  criterion  measure  of  Ranger 
duty  performance  in  the  validation  of  peer  ratings  obtained  at  Ranger 
school . 

Technical  Paper  345  confirmed  the  reliability  of  the  Performance 
Evaluation  Form  itself  and  its  ability  to  differentiate  between  require¬ 
ments  of  different  officer  assignments.  This  paper  analyzes  performance 
data  from  the  Officer  Basic  Course  in  relation  to  data  on  later  duty 
performance  to  determine  which  school  measures  best  predict  officer 
potential. 

The  work  was  done  in  the  Personnel  and  Manpower  Technical  Area, 
under  Army  Project  2Q162717A766.  A  version  of  this  report  was  presented 
at  the  1977  meeting  of  the  Military  Testing  Association. 
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RELATIONSHIP  BETWEEN  OFFICER  DUTY  PERFORMANCE  AND  CERTAIN  MEASURES 
OF  POTENTIAL 


BRIEF 


Requirement : 

To  determine  the  usefulness  of  certain  Officer  Basic  Course  (OBC) 
measures  in  predicting  later  duty  performance. 


Procedures: 

Performance  during  OBC  was  measured  on  the  seven  scales  of  the  Of¬ 
ficer  Evaluation  Battery,  OBC  final  grades,  and  peer  ratings  made  half¬ 
way  through  the  course  and  at  the  end  of  the  course.  Duty  performance 
was  assessed  by  ratings  with  the  special-purpose  Performance  Evaluation 
Form  and  standard  Officer  Efficiency  Report  ratings. 


Findings : 

Statistical  correlations  indicated  that  duty  performance  was  pre¬ 
dicted  best  by  the  end-of-course  peer  ratings,  and  next  best  by  course 
grades.  For  combat  arms  personnel,  peer  ratings  and  course  grades  were 
about  equally  predictive,  but  for  noncombat  arms  personnel  peer  ratings 
alone  correlated  best. 


Utilization  of  Findings: 

The  findings  confirme  ’  previous  research  on  the  predictive  value 
of  peer  ratings. 
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RELATIONSHIP  BETWEEN  OFFICER  DUTY  PERFORMANCE 
AND  CERTAIN  MEASURES  OF  POTENTIAL 


INTRODUCTION 

Previous  leadership  research  identified  eight  broad  domains  of  of¬ 
ficer  behavior  in  a  realistic  experimental  combat  situation  (Helme,  Wil- 
lemin,  &  Grafton,  1971).  The  efficacy  of  the  Differential  Officer  Bat¬ 
tery  in  predicting  performance  in  these  domains  was  reported  by  Helme, 
Willemin,  and  Day  (1971).  Another  area  of  related  research  concerned 
the  validity  of  associate  ratings  in  the  assessment  of  officer  potential 
(Parrish  &  Drucker,  1957;  Haggerty,  1963;  Gordon  &  Medland,  1965;  Downey, 
Medland,  &  Yates,  1976;  Gilbert  &  Downey,  1978). 

Research  based  on  the  prediction  utility  of  the  Differential  Offi¬ 
cer  Battery  led  to  the  development  of  the  Officer  Evaluation  Battery 
(OEB) ,  which  consists  of  seven  scales:  Combat  Leadership  (cognitive). 
Technical  Managerial  Leadership  (cognitive) ,  Career  Potential  (cognitive) , 
Combat  Leadership  (noncognitive) ,  Technical-Managerial  Leadership  (non- 
cognitive) ,  Career  Potential  (noncognitive) ,  and  Career  Intent.  In 
design,  this  instrument  reflects  two  of  the  major  domains  of  leadership 
reported  in  the  Helme,  Willemin,  and  Grafton  (1971)  research. 

The  objective  of  this  research  was  to  determine  the  efficacy  of 
certain  measures  obtained  in  the  Officer  Basic  Course  (OBC)  in  predicting 
subsequent  on-the-job  performance.  The  Officer  Basic  Course  measures 
were  scores  on  the  seven  scales  of  the  OEB,  OBC  final  course  grades, 
midcourse  peer  ratings,  and  final  course  peer  ratings.  On-the-job  per¬ 
formance  measures  consisted  of  a  special-purpose  Performance  Evaluation 
Form  and  Officer  Efficiency  Report  (OER)  ratings. 


PROCEDURE 


Data  Collection 


Approximately  5,000  officers  in  the  13  career  branches  who  attended 
the  Officer  Basic  Course  in  FY  1974  and  administered  the  Officer  Evalua¬ 
tion  Battery  were  used  as  subjects  in  this  research  program.  Peer  ratings 
were  obtained  at  the  midpoint  of  the  OBC  and  again  at  the  end  of  the 
course.  Final  course  grades  were  obtained  from  each  OBC  in  either  ac¬ 
tual  grades  or  in  class  standing  within  each  OBC  class,  or  both. 

The  Performance  Evaluation  Form  has  been  described  in  detail  else¬ 
where  (Gilbert,  1975;  Gilbert  &  Grafton,  1978;  Gilbert,  Hooper,  &  Hicks, 
1977) .  This  instrument  was  designed  to  measure  overall  duty  performance 
and  rankings  and  ratings  of  potential  performance  along  10  leadership 
dimensions.  Five  of  these  leadership  dimensions  correspond  to  factors 
derived  by  Helme,  Willemin,  and  Grafton  (1971)  and  also  to  the  factors 
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of  consideration  and  initiation  of  structure  identified  by  Fleishman 
(1974)  and  Stogdill  (1974) .  In  addition,  the  form  required  ratings  along 
the  more  global  dimensions  of  combat  leadership  and  technical-managerial 
leadership  identified  by  the  Helme,  Willemin,  and  Grafton  research. 

Figure  1  shows  the  dimensions  assessed  by  the  Performance  Evalua¬ 
tion  Form  with  the  corresponding  scale  of  the  form  and  the  abbreviated 
title  of  each  scale.  Figure  2  shows  the  7-point  scale  (adapted  from 
Willemin,  1965)  that  was  used  for  each  rating.  Raters  were  required  to 
rank  seven  of  the  scales  in  terms  of  an  officer's  potential  for  future 
performance,  and  then  to  rate  the  officer  in  these  seven  scales.  Three 
of  the  scales — Duty  Performance,  Combat  Leadership,  and  Technical- 
Managerial  Leadership — required  ratings  only. 

Wherever  possible,  ratings  on  the  Performance  Evaluation  Form  were 
obtained  from  four  raters:  the  officer's  immediate  supervisor,  a  super¬ 
ior  officer  other  than  the  officer's  immediate  supervisor  but  not  neces¬ 
sarily  the  OER-indorsing  official,  and  two  close  associates. 


Data  Preparation 

The  OBC  grades  and  class  standings  were  equated  by  ranking  (within 
the  class)  the  grades  of  officers  for  whom  class  grades  only  were  avail¬ 
able.  These  rankings  were  then  converted  to  standard  scores.  When 
class  rankings  were  available,  they  were  converted  to  standard  scores 
within  the  different  OBC  classes.  Scores  were  standardized  with  a  mean 
of  100  and  a  standard  deviation  of  20.  For  the  purpose  of  analysis, 
the  ratings  on  the  Performance  Evaluation  Form  were  averaged,  if  ratings 
were  available  from  at  least  two  raters. 


RESULTS  AND  DISCUSSION 

Table  1  shows  reliability  estimates  for  each  of  the  10  scales  of 
the  Performance  Evaluation  Form.  These  estimates  are  based  on  cases 
for  which  all  four  ratings  were  available  in  the  sample.  Estimates 
were  obtained  by  averaging  the  six  possible  correlations  among  the  four 
raters  and  adjusting  the  resulting  average  by  the  Spearman -Brown  Prophecy 
formula. 

The  reliability  estimates  ranged  from  .70  for  the  Combat  Leadership 
scale  to  .55  for  the  Logistical  Knowledge  scale.  These  estimates  sup¬ 
port  the  findings  of  Willemin  (1965) . 

Table  2  shows  the  correlations  between  the  10  predictor  variables 
and  each  of  the  10  scales  of  the  Performance  Evaluation  Form  for  the 
entire  sample.  Table  2  also  shows  the  multiple  correlations  between 
the  10  predictor  variables.  This  table  reveals  that  final  course  peer 
ratings  yielded  the  highest  zero-order  correlations  for  eight  of  the 
scales;  the  two  exceptions  were  for  the  Technical-Managerial  scale  and 
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Performance  Evaluation 

Form  scale 

Factor 

Abbreviated  title 
of  scale 

Part  I 

Duty  performance 

Duty  performance 

Part  II 

Applying  tactical  knowledge  and 
skills  in  support  of  combat 
operations 

Tactical  staff  skills3 

Tactical  knowledge 

Understanding  the  mission  and 
clearly  defining  personal 
roles  of  subordinates  in 
its  accomplishment 

a 

Team  leadership 

Defining  personal 
roles 

Making  decisions  and  initiating 
actions  under  pressure 

Command  of  men3 

Making  decisions 

Defining  functional  roles  and 
duties  in  the  process  of  de¬ 
veloping  subordinates  to 
fill  assignments  for  long¬ 
term  unit  effectiveness 

Initiation  of  structure*3  ,c 

Defining  functional 
roles 

Planning  and  organizing  man¬ 
power  and  materiel  to  meet 
situational  requirements 

Executive  direction3 

Planning  and 
organization 

Motivating  troops  to  accomplish¬ 
ing  the  mission  by  taking 
into  consideration  their 
well-being  and  morale 

h  c 

Cons ider ation“ ' 

Motivating  troops 

Applying  knowledge  of  logistics 
and  technical  matters  to 
solve  support  problems 

Technical  staff  skills3 

Technical  knowledge 

Part  III 

Combat  leadership 

Combat  leadership3 

Combat  leadership 

Technical-managerial  leadership 

Technical-managerial 

leadership3 

Technical-managerial 

leadership 

aHelme,  Willemin,  and  Grafton  (1971) . 
^Fleishman  (1974). 
cStogdill  (1974). 


Figure  1.  Performance  Evaluation  Form  scales  and  corresponding 
factors  and  abbreviated  scale  titles. 


Scale  value 


Description 


7  OUTSTANDING  Far  above  the  requirements  of  the  situation, 

suggesting  the  highest  kind  of  formal  recogni¬ 
tion  through  meritorious  award,  or  decoration. 

6  SUPERIOR  Markedly  above  the  requirements  of  the  situa¬ 

tion,  suggesting  formal  recognition  through  a 
special  (favorable)  efficiency  report,  or 
letter  of  commendation. 

5  ABOVE  AVERAGE  Somewhat  above  the  requirements  of  the  situa¬ 

tion,  suggesting  informal  recognition  through 
specific  favorable  comment  in  his  regular  ef¬ 
ficiency  report,  and  through  informal  appreci¬ 
ation  or  commendation. 


4  AVERAGE 


3  BELOW  AVERAGE 


2  MARGINAL 


1  UNSATISFACTORY 


Fully  up  to  the  requirements  of  the  situation, 
suggesting  general  appreciation  (perhaps  mostly 
unexpressed) . 

Somewhat  below  the  requirements  of  the  situa¬ 
tion,  though  suggesting  only  the  mildest  kind 
of  corrective  action  through  informal  recom¬ 
mendation  for  improvement,  or  through  change 
of  duty  assignment  within  the  organization. 

Markedly  below  the  requirements  of  the  situa¬ 
tion,  suggesting  formal  corrective  action 
through  a  special  (unfavorable)  efficiency 
report,  administrative  admonition,  letter  or 
reprimand,  summary  court,  or  transfer  out  of 
the  organization. 

Far  below  the  requirements  of  the  situation, 
suggesting  the  most  drastic  kind  of  formal 
corrective  action  through  reclassification, 
demotion,  general  court,  or  boarding  out  of 
the  Army. 


Figure  2. 


Officer  performance 


scale . 


a 


aAdapted  from  Willemin 


(1965)  . 
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the  Tactical  Knowledge  scale.  Final  course  peer  ratings  were  most 
predictive  of  Duty  Performance,  Combat  Leadership,  and  Making  Decisions. 


Table  1 

Reliability  Estimates  for  Each  Scale  of  the 
Performance  Evaluation  Form 


Scale 

Reliability 

estimate 

Duty  Performance 

.67 

Combat  Leadership 

.70 

Technical-Managerial  Leadership 

.58 

Tactical  Knowledge 

.68 

Understanding  Mission 

.59 

Making  Decisions 

.66 

Defining  Functional  Roles 

.58 

Planning  and  Organizing 

.57 

Motivating  Troops 

.60 

Logistical  Knowledge 

.55 

Table  3  shows  the  correlations  among  the  same  set  of  variables 
and  for  corresponding  multiple  correlations  for  the  combat  arms  branches. 
These  branches  are  air  defense,  armor,  field  artillery,  and  infantry.  In 
this  analysis,  final  course  peer  ratings  yielded  higher  or  equal  zero- 
order  correlations  with  the  criteria,  as  did  other  predictors  in  all  but 
two  instances — the  Technical-Managerial  Leadership  scale  and  the  Logisti¬ 
cal  Knowledge  scale. 

Table  4  shows  the  correlations  between  each  set  of  predictors  and 
each  of  the  10  criteria  and  corresponding  multiple  correlations  for  the 
branches  other  than  the  combat  arms  branches.  For  all  of  the  criteria, 
with  the  exception  of  the  Technical-Managerial  scale,  the  zero-order 
correlations  between  final  course  peer  ratings  and  the  criteria  were 
higher  than  or  equal  to  the  zero-order  correlations  between  each  of  the 
other  variables  and  each  of  the  criteria. 

In  general ,  the  results  of  these  analyses  indicate  that  final  OBC 
peer  ratings  are  the  best  predictors  of  duty  performance  when  measured 
by  the  Duty  Performance  scale  of  the  Performance  Evaluation  Form  for  the 
total  sample.  The  zero-order  correlation  in  this  instance  is  .26  between 
final  course  peer  ratings  and  duty  performance;  the  next  highest  zero- 
order  correlation  is  .19  between  duty  performance  and  OBC  final  grades. 
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Correlation  Between  Each  Predictor  and  Each  Scale  of  the  Performance 


Predictor  CLC  =  Combat  Lead,  (cog)  CPNC  =  Career  Pot.  (noncog)  ‘Significant  at  the  .05 

TMC  =  Tech-Manag.  Lead,  (cog)  Cl  =  Career  Intent  level. 

CPC  =  Career  Pot.  (cog)  OBCG  =  OBC  Course  Grade  “Significant  at  the  .01 

CLNC  =  Tech-Manag.  Lead,  (noncog)  PRM  =  Midcourse  Peer  Ratings  level. 

TMNC  =  Tech-Manag.  Lead,  (noncog)  PRF  =  Final  Peer  Ratings 


Correlation  Between  Each  Predictor  and  Each  Scale  of  the  Performance 
Evaluation  Form  and  Corresponding  Multiple  Correlation  for  the 
Combat  Arms  Branches  (N  =  1,193) 


CLC  =  Combat  Lead,  (cog)  CPNC  =  Career  Pot.  (noncog)  ‘Significant  at  the  .05 

TMC  =  Tech-Manag.  Lead,  (cog)  Cl  =  Career  Intent  level. 

CPC  =  Career  Pot.  (cog)  OBCG  =  OBC  Course  Grade  “Significant  at  the  .01 

CLNC  =  Tech-Manag.  Lead,  (noncog)  PRM  =  Midcourse  Peer  Ratings  level. 

TMNC  =  Tech-Manag.  Lead,  (noncog)  prf  =  Final  Peer  Ratings 


Correlation  Between  Each  Predictor  and  Each  Scale  of  the  Performance 
Evaluation  Form  for  Branches  Other  Than  Combat  Arms  (N  =  915) 


TMC  =  Tech-Manag.  Lead,  (cog)  Cl  =  Career  Intent  .05  level. 

CPC  =  Career  Pot.  (cog)  OBCG  =  OBC  Course  Grade  **Signif icant  at  the 

CLNC  =  Tech-Manag.  Lead,  (noncog)  PRM  =  Midcourse  Peer  Ratings  .01  level. 

TMNC  =  Tech-Manag.  Lead,  (noncog)  PRF  =  Final  Peer  Ratings 


In  the  combat  arms  branches,  there  is  little  difference  between 
the  predictive  value  of  peer  ratings  and  OBC  final  grades  for  duty  per¬ 
formance.  For  branches  other  than  the  combat  arms,  nowever,  the  corre¬ 
lation  between  final  course  ratings  and  duty  performance  is  .30;  the 
correlation  between  grades  and  duty  performance  is  .16. 

The  last  analyses  involved  the  relationships  between  the  predictors 
and  the  weighted  average  OER  ratings.  Table  5  shows  the  results  of 
these  analyses.  For  the  total  sample,  final  course  peer  ratings  yielded 
a  correlation  of  .21  with  OER  ratings;  however,  the  final  grades  obtained 
in  the  OBC  yielded  a  correlation  of  .20.  In  the  combat  arms  branches, 

OBC  final  bourse  grades  yielded  a  slightly  higher  zero-order  correlation 
with  OER  ratings,  whereas  the  opposite  occurred  in  branches  other  than 
combat  arms. 

The  results  of  this  research  are  similar  to  results  of  other  re¬ 
ports  on  the  utility  of  associate  ratings  or  peer  ratings  in  predicting 
subsequent  performance  (Helme,  1969;  Gilbert,  1975;  Gilbert  &  Downey, 
1978) .  Further  research  will  explore  how  the  predictive  utility  of  peer 
ratings  may  be  enhanced.  One  possible  approach  would  be  to  divide  the 
sample  into  individual  career  branches,  since  some  differences  in  pre¬ 
dictive  power  between  combat  arms  branches  and  the  other  branches  were 
observed  in  this  research.  Another  possibility  would  be  to  divide  the 
sample  according  to  the  similarities  of  specialties  in  which  the  offi¬ 
cers  are  engaged. 


Table  5 


Correlation  Between  Each  Predictor  and  Weighted  Average  Officer 
Efficiency  Ratings  and  Corresponding  Multiple  Correlations 
for  Combat  Arms,  Branches  Other  Than  Combat  Arms, 
and  Total  Sample 


Predictor 

Combat  arms 
(n  =  2,486) 

Branches  other  than 
combat  arms 
(n  =  2,120) 

Total 

(n  =  4,506) 

Combat  Leadership 
(cognitive) 

.06 

.05 

.06 

Technical-Managerial 

Leadership 

(cognitive) 

.02 

-.01 

.01 

Career  Potential 
(cognitive) 

.01 

.04 

.02* 

Combat  Leadership 
(noncognitive) 

.08* 

.10** 

.09** 

Technical-Managerial 
Leadership 
(noncognitive ) 

.10** 

.09** 

.10** 

Career  Potential 
(noncognitive) 

.02 

.01 

.02 

Career  Intent 

.02 

.06 

.04 

OBC  grades 

.25** 

.15** 

.20** 

Midcourse  peer  ratings 

.12** 

.11** 

.11** 

Final  peer  ratings 

.22** 

.21** 

.21** 

Multiple  correlations 

.30** 

.24** 

.26** 

‘Significant  at  the  .05  level. 
••Significant  at  the  .01  level. 
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